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Abstract. 

In this paper we prove large deviations principles for the Nadaraya-Watson estimator of the regression of a 
real-valued variable with a functional covariate. Under suitable conditions, we show pointwise and uniform 
large deviations theorems with good rate functions. 
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1 Introduction 

Let {(Yi, Xi), i > 1} be a sequence of independent and identically distributed random vectors. The random 
variables Yi are real, with E|F| < oo, and the Xi are random vectors with values in a semi-metric space 

(#,d(v)). 

Consider now the functional regression model, 



Yi := E(Y\Xi 



r(Xi) 



(1) 



where r is the regression operator mapping X onto R, and the s% are real variables such that, for all i, 
E(ej|Xi) = and E(ef|Xj) = o 2 e (Xi) < oo. Note that in practice X is a normed space which can be of 
infinite dimension (e.g., Hilbert or Banach space) with norm || • || so that d(x, x') = \\x — x'\\, which is the case 
in this paper. 



Ferratv and Vieu I (120041) provided a consistent estimate for the nonlinear regression operator r, based on the 
usual finite-dimensional smoothing ideas, that is 



r n (x) :- 



(2) 



where K(-) is a real-valued kernel and h n the bandwidth, is a sequence of positive real numbers converging 

to as n — ► oo. Note that the bandwidth h n depends on n, but we drop this index for simplicity. In what 

r ( u 



follows Kh(u) stands for K ( — 1 . The estimator defined in (f2]l is a generalization to the functional framework 

of the classical Nadaraya-Watson regression estimator. The asymptotic properties of this estimate have been 
studied extensivel y by several autho r s, we cite among others 
the monograph bv lFerratv and Vieu I (|2006). 



Ferratv et al. 



(2007|), for a complete survey see 



The large deviations beh avior of the Nadaraya-Watson estima te of the regres sion function, have been studied 
at first by 



Louani 



(|1999h . sharp results have been ob tained by 



Joutard 



Mokkadem et al. 



(2006) in the univariate framework. In 



the multidimensional case 
for the Nadaraya-Watson and recursive kernel estimators of the regression. 



(2008) obtained pointwise large and moderate deviations results 



E-mail address: mohamed.cherfi@upmc.fr 



In this work, we are interested in the problem of establishing large deviations principles of the regression 
operator estimate r„( ). The results stated in the paper deal with pointwise and uniform large deviations 
probabilities of r„(-) from r(-). The organization of the paper is as follows, in Section 2 we will state pointwise 
and uniform large deviations results. The proofs are given in section 3. 



2 Results 



Let F x (h) = P\\\X j — x\\ < h],be the cumulative distribution of the real variable Wi = \\Xi — x\\. As in 
Ferratv et al. 



(2007), let ip be the real valued function defined by 

<p(u) = E{r(X) - r(x)\ \\X - x\\ = u}. 



(3) 



Before stating our results, we will consider the following conditions. 

(C.l) The kernel K is positive, with compact support [0, 1] of class C 1 on [0, 1), K(l) > and its derivative 
K' exists on [0, 1) and K'(u) < 0. 

(C.2) K is Lipschitz. 

(C.3) The operator r verifies the following Lipschitz property: 

V(«, v) G X 2 , 3C, \r(u) - r{v)\ < C\\u - vf (4) 

(C.4) There exist three functions £(•), <p(-) (supposed increasing and strictly positive and tending to zero as h 
goes to zero) and Co( - ) sucn tnat 



(i) F x (h) = l{x)4>{h) + o(4>(h)), 

(fi(uh) 



(ii) for all u £ [0, 1], lim/^o ^frr =: ^h->o (h{u) = (o{u). 



C.5 ip'(0) exists. 

There exist many exampl e s fulfi lling the decomposition mentioned in condition (C.4), see for instance Propo- 
sition 1 in 

functional data, see for instance 



Ferratv et al. 



(2007) . The conditions s tated above are classical in nonparametric estimation for 



Ferratv et al. I ( 12007b and references cited therein. 



Let now introduce the following functions, 



I(t) = exp{-tXK(l)} -1 + tX / K'(u) exp{-t\K(u)}( (u) dw; 



(5) 



T+(A) = M{£(x)I(t)}; T-(A) = M{£(x)I(-t)} andT^A) = max{r+(A); r~(A)}. 

Let x be a an element of the functional space X and A > 0. Our first theorem deals with pointwise large 

deviations probabilities. 

Theorem 1 Assume that the conditions (C.1)-(C.5) are satisfied. Ifn<fi(h) — ► oo, then for any A > and 
any x G X, we have 



(a) 



(b) 



(O 



lim 



1 



n<j)(h) 

n— >oo n<j)(h) 
1 



n-+oo ncf>(h) 



logP(r n (x)-r(x) > A) =T+(A) 
log P(r n (x)-r(x) < -A) =T-(A) 
logP(|f n (x)-r(x)| > A) =T X (A) 



(6) 



(7) 



(8) 



2 



To establish uniform large deviations principles for the regression estimator we need the following assumptions. 
Let C be some compact subset of X and B(zk, £) a ball centered at Zk G X with radius £, such that for any 

£>o, 



Cc |J B(z k ,Q, 



k=l 



3a > 0, 3C> 0, tC = C. 



(9a) 



(9b) 



The above conditions on the covering of the compact set C by a finite number of balls, the geometric link 
between the number of balls r and the radius £ are necessary to prove uniform convergence in the context 
of functional non-param etric regression and many functional non-parametric settings, see the discussion in 



Ferratv and Vieu 



(2008) 



Before stating the Theorem about the uniform version of our result, we introduce the following function 



g(X) = supT x (A). 

zee 



(10) 



Theorem 2 Assume that the conditions (C.1)-(C.5) are satisfied. Ifn<fi(h) — > oo, then for any compact set 
C C X satisfying conditions ([9} and for any A > 0, 

lim — I7TC lo g p ( su Pl*v(aO -r(x)\ > A) = g(X) (11) 
*-><*> ntp{h) v aeC 

3 Proofs 

3.1 Proof of Theorem U 

We only prove the statement (O, (O is derived in the same way. 
(a) Write 

n 

= Y,i Y >- r ( s ) - x } K h(\\ x i - x \\) 

i=l 

Define §x^(t) := Eexp(iZ n ) to be the moment generating function of Z n . To prove the large deviations 

principles, we seek the limit of — — — - log (t) as n — ► oo. 

n<p[h) 

Observe that 

$<W(t) - |l +E^exp{i[r(X 1 ) - r(x) - A]Jf h (||Xi - z||)} - 
Using the definition of the function <y9 in (0, we can write 

*<W(t) = jl + E^exp^bdlXi-^ID-Al^dlXi-xll)}-! 

1 + / f exp{%(u) - A]iffc(ti)} - l) di^(u) 



n 



ii 



= { 1 + / exp{%(>u) - A]isT(u)} - 1 di^/m) 



By (C.5), using a first order Taylor expansion of (p about zero, we obtain 



^\t) = |l + J (exp{t[huip'(Q)-X + o(l)]K{u)}-l\ dF x (hu)\ , 
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Integrating by parts and by (C.l), we have 



1 

t[h<p'{0)K(u) + K'(u)(uh<p'(0) - A)] 



o 



Therefore, 



exp{t[hwp'(0) - \}K(u)}F x (hu) du 



log$W(t) = 7ilog{l+(exp{t[V(0)-A]tf(l)}-l)F x (/0 

t[V(0)i^(u) + if'(n)(wV(0) - A)] 
exp{t[/i?V(0) - A]l<f(u)}F x (7m) du 



Using Taylor expansion of log(l + v) about v — 0, we obtain 

log #<">(<) = n{(exp{t[V(0)-A]*:(l)}-l)F x (/i) 



t[h<p'(0)K(u) + K'(u)(uhip'(0) - A)] 
exp{t[hu<p'(0) - A]iT(>)}.F x (/m) du + 0{h) 



Hence, from Assumption (C.4) (ii) it follows that 

Urn — %—\og&f>(t) = £(x)i exp{-tXK(l)}- 1 + tX f K'(u)exp{-tXK(u)}C (u) du 

n^oo n<p(hj [ 



(I 



*(s)J(t). 



Using Theorem of iPlachkv and Steinebachl ( 11975b . the proof of the theorem can be completed as in 



Louani 



(1998). 



(c) Observe that for any x G X, 

max{P(r n (x) - r(x) > A); P{r n (x) - r(x) < -A)} < P(\r n (x) - r(x)\ > A) 

and 

P(\r n (x) - r(x)\ > A) < 2 max{P(f n (a;) - r(x) > A); P(? n (x) - r(x) < -A)}. 

Hence, 

r«(A) < lim -±- logP(|? n (.x) - r(x)\ > A) < max{r+(A); r~(A)} = r x (A), 
n— >oo n<p(n) 

which complete the proof. 

3.2 Proof of Theorem 1 

First for any xo G C, by TheoremQ]we have 

liminf 1 logPfsup \r n (x) - r(x)\ > A) > liminf 1 logP(|f„(a;o) - r(x )\ > A) 

n^oo n<p{h) x£C n^oo n<p{h) 

> r X0 (A). 
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Hence 

liminf logP( sup \r n (x) - r(x)\ > A) > g(X). (12) 

n^oo n<p{h) x x ec 

To prove the reverse inequality, we note that by conditions (0 it follows 

sup \r n (x) — r(x)\ < max sup \r n (x) — r(x)\. (13) 

xeC l<fc<T x£B(z k ,£) 

Hence, 

sup \r n (x) - r(x)\ < sup \r n (x) - r n (z k )\ + sup \r(z k ) - r(x)\ + \r n (z k ) - r(z k )\. (14) 

xeB(z k ,i) xeB(z k ,£) xeB(z k .£) 

Using the fact that K is Lipschitz by condition (C.2), there exists C > so that 

sup \r n (x) -r n (z k )\ < V |^|. 

xeB(x k ,£) ruj>{h)hf-^ 

For n sufficiently large, we choose £ according to the preassigned e > 0, so that 

sup \r n (x) - r n {z k )\ < e. (15) 

xeB(z k ,£) 

Moreover, r is Lipschitz, hence for a suitable choice of £ 

sup \r(zk) - r(x)\ < e. (16) 

x&B(z k ,£) 



Finally, $TB-$T(fr yield 



sup \r n {x) - r(x)\ < max {\r n {z k ) - r{z k )\ + 2e}, (17) 
xec i<k<T 



which implies 

T 

P(sup\r n (x)-r(x)\ > A) <^P(\r n (z k ) -r(z k )\ >A-2e). 



k=i 



Thus, 



P(sup |r n (x) - r(x)| > A) < t max P(\r n (z k ) - r(z k )\ > A - 2e). 

a;eC l<fc<T 



It follows, by TheoremQ] that 



limsup — i— - logP(sup |r n (x) — r(x)| > A) < inf sup^(x)J e (f), 

n — >oo 



where 



I e {t) = cxp{-(tA - 2e)if(l)} - 1 + 1{\ - 2e) / if » exp{-t(A - 2e)K(u)}Co(u) du. 

Jo 

By continuity arguments, and the fact that 

inf svp£(x)I(t) = sup inf £(x)I(t), 

t>0 xt£C x£C t>0 

we obtain 

limsup logP(sup|f n (x) -r(x)\ > A) < g(X). (18) 

n^oc n(p{h) v ae c 

Combining (fT2l and ( TT8l . we see that the limit exists which is 5(A). 
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